Method and apparatus for providing predictive maintenance of a device by using markov transition probabilities

ABSTRACT

A method for providing predictive maintenance of a device, comprises the steps of modeling as a time series of a discretely sampled signal representative of occurrences of a defined event in the operation of the device, the time series being modeled as two-state first order Markov processes with associated transition probabilities, wherein one state applies when the number of the occurrences exceeds a certain threshold, and the other state applies when the number of the occurrences falls below the certain threshold; computing the four transition probabilities the last N states S n , where N is a predetermined number, conducting a supervised training session utilizing a set of J devices, which have failed due to known causes and considering the two independent probabilities and, the training session comprising computing the two-dimensional feature vectors for the initial M windows of N scans, computing the two-dimensional feature vectors for the final N number of scans, plotting a scatter-diagram of all 2D feature vectors, and deriving a pattern classifier by estimating the optimal linear discriminant which separates the two foregoing sets of vectors; and applying the classifier to monitor the persistence of occurrences of the defined event in the operation of the device.

[0001] Reference is hereby made to copending:

[0002] U.S. Provisional Patent Application No. 60/255,615 filed Dec. 14, 2000 for NEURAL NETWORK-BASED VIRTUAL AGE ESTIMIATION FOR REMAINING LIFETIME, in the names of Christian Darken and Markus Loecher;

[0003] U.S. Provisional Patent Application No. 60/255,614 filed Dec. 14, 2000 for POLYNOMIAL BASED VIRTUAL AGE ESTIIMATION FOR REMAINING LIFETIME PREDICTION, in the names of Markus Loecher and Christian Darken; and

[0004] U.S. Provisional Patent Application No. 60/255,613 filed Dec. 14, 2000 for MARKOV TRANSITION PROBABILITIES FOR PREDICTIVE MAINTENANCE, in the name of Markus Loecher, of which priority is claimed and whereof the disclosures are hereby incorporated herein by reference.

[0005] Reference is also made to copending patent applications being filed on even date herewith:

[0006] METHOD AND APPARATUS FOR PROVIDING A VIRTUAL AGE ESTIMATION FOR REMAINING LIFETIME PREDICTION OF A SYSTEM USING NEURAL NETWORKS, in the names of Christian Darken and Markus Loecher, Attorney Docket No. 00P9072US01; and METHOD AND APPARATUS FOR PROVIDING A POLYNOMIAL BASED VIRTUAL AGE ESTIMATION FOR REMAINING LIFETIME PREDICTION OF A SYSTEM, in the names of Markus Loecher and Christian Darken, Attorney Docket No. 00P9073US01, and whereof the disclosures are hereby incorporated herein by reference.

[0007] The present invention relates generally to the field of failure prediction and, more specifically to providing advance warning of impending failure for a variety of systems and devices, terms used herein interchangeably.

[0008] Devices and apparatus used in various fields of medicine, industry, transportation, communications, and so forth, typically have a certain useful or operational life, after which replacement, repair, or maintenance is needed. Generally, the expected length of the operational life is known only approximately and, not untypically, premature failure is a possibility. Simple running time criteria are typically inadequate to provide timely indication of an incipient failure. In some applications, unanticipated failure of devices constitutes a at least a nuisance; however, more typically, unanticipated device failure may be a major nuisance leading to costly interruption of services and production. In other cases, such unexpected failure can seriously compromise safety and may result in potentially dangerous and life-threatening situations.

[0009] In accordance with an aspect of the invention, systems and/or devices are classified into “healthy” states and conditions which signal imminent malfunction is accomplished through computation of transition probabilities of selected variables.

[0010] In accordance with an aspect of the invention, a method for providing predictive maintenance of a device, comprises the steps of modeling as a time series of a discretely sampled signal representative of occurrences of a defined event in the operation of the device, the time series being modeled as two-state first order Markov processes with associated transition probabilities, wherein one state applies when the number of the occurrences exceeds a certain threshold, and the other state applies when the number of the occurrences falls below the certain threshold; computing the four transition probabilities the last N states S_(n), where N is a predetermined number, conducting a supervised training session utilizing a set of J devices, which have failed due to known causes and considering the two independent probabilities and, the training session comprising computing the two-dimensional feature vectors for the initial M windows of N scans, computing the two-dimensional feature vectors for the final N number of scans, plotting a scatter-diagram of all 2D feature vectors, and deriving a pattern classifier by estimating the optimal linear discriminant which separates the two foregoing sets of vectors; and then applying the classifier to monitor the persistence of occurrences of the defined event in the operation of the device.

[0011] The method and apparatus will be more fully understood from the following detailed description of preferred embodiments, in conjunction with the Drawing in which

[0012]FIG. 1 (SOLE FIGURE) shows a block diagram for apparatus in accordance with the principles of the invention.

[0013]FIG. 1 shows a computer 20 equipped with data and program storage equipment 22 and a source 26 of programs for training and operating in an interactive manner as hereinafter described. Data from training sessions as further explained below is provided at 24. A device or system 28 which is being monitored provides data by way of data collection interface unit 30 to computer 20. Computer 20 provides an imminent or prospective alarm as to lifetime expiration and/or failure expectation at an alarm device 32.

[0014] An important exemplary application of principles of the present invention relates to predicting failure of X-ray tubes. Arcing is known to occur in X-ray tubes. In the case of X-ray tubes, the frequency of occurrence of high-voltage (HV) arcs is chosen as the main input to the algorithm in the present exemplary embodiment. HV-arcing is characterized by a lightning-like discharge and a temporary voltage breakdown inside vacuum-insulated high-voltage devices. Typically, it is a frequently occurring but usually short-lived malfunction in such devices.

[0015] The method in accordance with the present invention is widely applicable in many fields. In order to facilitate understanding of the invention and to illustrate the use of device-specific information and parameters, the invention will next be more fully described by way of an exemplary, non-limiting embodiment relating to X-ray tubes; where appropriate, generally applicable notions are also stated in the context of the specific exemplary embodiment. The example used is also appropriate in that an unexpected failure of such an X-ray tube, for example during a critical surgical procedure, should be avoided insofar as is possible.

[0016] Suppose x_(n) (n=1 . . . N) represents the time series of a discretely sampled signal which for the sake of clarity is assumed in the present embodiment to be the number of high-voltage arcs measured during the active phase of an X-ray tube. Furthermore, it is assumed that the X-ray tubes are operated in a non-continuous manner, which is characteristic for a clinical environment where discrete, consecutive “scans” represent its main usage.

[0017] The physical causes for HV-arcs primarily fall into three classes: (i) leaks in the casing, which lead to a reduced vacuum, (ii) microscopic particles, which are usually destroyed by the arcing, and (iii) sharp protrusions on the surface of the anode or cathode. Arcing due to leaks marks the irreversible decay of a tube's proper functioning. On the contrary, the latter two disruptions are transitory and reversible. In fact, in cases (ii) and (iii) arcing (a symptom) serves to eradicate its own cause by destroying the particles or protrusions.

[0018] Consistent with this physical picture, the time-series x_(n) shows noticeable persistence and cannot be modeled by e.g. a Poisson process. Removal of particulates requires a sufficient number of consecutive HV-arcs, which manifests itself as strong temporal correlations within x_(n). The fundamental problem is to decide, based solely upon a finite history of arcing, whether the tube is about to irreversibly fail or whether the malfunctioning can be considered transitory.

[0019] In accordance with an aspect of the invention, the timeseries x_(n) is modeled as two-state first order Markov processes with associated transition probabilities p(i|j). State 1 is assumed if the number of arcs exceeds a certain threshold T, state 0 if it falls below the same number: $S_{n} = \left\{ \begin{matrix} 0 & {if} & {x_{n} \leq T} \\ 1 & {if} & {x_{n} > T} \end{matrix} \right.$

[0020] We typically take T to be zero. Assuming x_(n) to result from an underlying 1^(st) order Markov processes implies stochastic switching between the two states. The transition probability p(i|j) is the switching probability from state j to state i. More accurately, it is the probability that S_(n)=i given that S_(n−1)=j. These four transition probabilities are computed over the last N states S_(n), where N typically is of the order of a few hundred scans. Note that the transition probabilities of a k^(th) order Markov process would depend on the last k states: p(S_(n))=p(S_(n)|S_(n−1, . . . ,) S_(n−k)).

[0021] We simplify the classification problem by only considering the two probabilities p(1|1) and p(1|0). Note that the two remaining probabilities are not independent: p(0|1)=1−p(1|1) and p(0|0)=p(0|0)=1−p(1|0). Utilizing a set of J tubes, which have failed due to known causes, the supervised training strategy in accordance with the principles of the invention is as follows:

[0022] Compute the two-dimensional feature vectors ƒ_(i)={p(1|1), p(1|0)}_(i) for the initial M windows of N scans.

[0023] Compute the two-dimensional feature vectors ƒ_(f)={p(1|1), p(1|0)_(ƒ)for the final N number of scans.

[0024] Plot a scatter-diagram of all 2D feature vectors (ƒ_(i))_(n) and (ƒ_(ƒ))_(n), (n=1 . . . J).

[0025] Now the problem is reduced to a classic pattern classifier: Estimate the optimal linear discriminant, which separates the two sets of vectors.

[0026] The classifier thereby obtained is applied to monitor the persistence of arcing in operating tubes. At each scan the transition probabilities are updated and the feature vector ƒ={p(1|1), p(1|0)} constructed. If ƒ falls into the “bad” region of the classifier, the tube is deemed close to the end of its useful life and advance warning of imminent failure is given.

[0027] It will be understood that the invention may be implemented in a number of ways, utilizing available hardware and software technologies. Implementation by way of a programmable digital computer is suitable, with or without the addition of supplemental apparatus. A dedicated system may also be used, with a dedicated programmed computer and appropriate peripheral equipment. When various functions and subfunctions are implemented in software, subsequent changes and improvements to the operation are readily implemented.

[0028] While the present invention has been described by way of illustrative embodiments, it will be understood by one of skill in the art to which it pertains that various changes and modifications may be made without departing from the spirit of the invention. Such changes and modifications are intended to be within the scope of the claims following. 

What is claimed is:
 1. A method for providing predictive maintenance of a device, comprising the steps of: modeling as a time series x_(n) of a discretely sampled signal representative of occurrences of a defined event in the operation of said device, said time series x_(n) being modeled as two-state first order Markov processes with associated transition probabilities p(i|j), wherein state 1 applies when the number of said occurrences exceeds a certain threshold T, and state 0 applies when the number of said occurrences falls below said certain threshold T, being represented as: $S_{n} = \left\{ \begin{matrix} 0 & {if} & {x_{n} \leq T} \\ 1 & {if} & {x_{n} > T} \end{matrix} \right.$

wherein said transition probability p(i|j) is the switching probability from state j to state i, that is, the probability that S_(n)=i given that S_(n−1)=j, being a total of 4 transition probabilities; computing said four transition probabilities the last N states S_(n), where N is a predetermined number; conducting a supervised training session utilizing a set of J devices, which have failed due to known causes and considering the two independent probabilities p(1|1) and p(1|0), said training session comprising: computing the two-dimensional feature vectors f_(i)={p(1|1), p(1|0)}_(i) for the initial M windows of N scans, computing the two-dimensional feature vectors f_(f)={p(1|1), p(1|0)_(f) for the final N number of scans, plotting a scatter-diagram of all 2D feature vectors (f_(i))_(n) and (f_(f))_(n), (n=1 . . . J), and deriving a pattern classifier by estimating the optimal linear discriminant which separates the two foregoing sets of vectors; and applying said classifier to monitor the persistence of occurrences of said defined event in the operation of said device.
 2. A method for providing predictive maintenance of a device as recited in claim 1, including the steps of: updating said transition probabilities at each scan are updated; and constructing the feature vector f={p(1|1), p(1|0)} constructed.
 3. A method for providing predictive maintenance of a device as recited in claim 2, including the step of: providing a warning of imminent failure of said device if f falls into a region of said classifier corresponding indicating such failure prediction.
 4. A method for providing predictive maintenance of an X-ray tube, comprising the steps of: modeling as a time series x_(n) of a discretely sampled signal representative of occurrences of arcing in the operation of said tube, said time series x_(n) being modeled as two-state first order Markov processes with associated transition probabilities p(i|j), wherein state 1 applies when the number of said occurrences exceeds a certain threshold T, and state 0 applies when the number of said occurrences falls below said certain threshold T, being represented as: $S_{n} = \left\{ \begin{matrix} 0 & {if} & {x_{n} \leq T} \\ 1 & {if} & {x_{n} > T} \end{matrix} \right.$

wherein said transition probability p(i|j) is the switching probability from state j to state i, that is, the probability that S_(n)=i given that S_(n−1)=j, being a total of 4 transition probabilities; computing said four transition probabilities the last N states S_(n), where N is a predetermined number; conducting a supervised training session utilizing a set of J X-ray tubes, which have failed due to known causes and considering the two independent probabilities p(1|1) and p(1|0), said training session comprising: computing the two-dimensional feature vectors f_(i)={p(1|1), p(1|0)}_(i) for the initial M windows of N scans, computing the two-dimensional feature vectors f_(f)={p(1|1), p(1|0)_(f) for the final N number of scans, plotting a scatter-diagram of all 2D feature vectors (f_(i))_(n) and (f_(f))_(n), (n=1 . . . J), and deriving a pattern classifier by estimating the optimal linear discriminant which separates the two foregoing sets of vectors; and applying said classifier to monitor the persistence of occurrences of said arcing in the operation of said X-ray tube.
 5. A method for providing predictive maintenance of an X-ray tube as recited in claim 4, including the steps of: updating said transition probabilities at each scan are updated; and constructing the feature vector f={p(1|1), p(1|0)} constructed.
 6. A method for providing predictive maintenance of an X-ray tube as recited in claim A5, including the step of: providing a warning of imminent failure of said X-ray tube if f falls into a region of said classifier corresponding indicating such failure prediction.
 7. A method for providing predictive maintenance of a device comprises the steps of modeling as a time series of a discretely sampled signal representative of occurrences of a defined event in the operation of said device, said time series being modeled as two-state first order Markov processes with associated transition probabilities, wherein one state applies when the number of said occurrences exceeds a certain threshold, and the other state applies when the number of said occurrences falls below said certain threshold; computing said four transition probabilities the last N states S_(n), where N is a predetermined number, conducting a supervised training session utilizing a set of J devices, which have failed due to known causes and considering the two independent probabilities and, said training session comprising computing the two-dimensional feature vectors for the initial M windows of N scans, computing the two-dimensional feature vectors for the final N number of scans, plotting a scatter-diagram of all 2D feature vectors, and deriving a pattern classifier by estimating the optimal linear discriminant which separates the two foregoing sets of vectors; and applying said classifier to monitor the persistence of occurrences of said defined event in the operation of said device.
 8. Apparatus for providing predictive maintenance of a device, comprising: means for modeling as a time series x_(n) of a discretely sampled signal representative of occurrences of a defined event in the operation of said device, said time series x_(n) being modeled as two-state first order Markov processes with associated transition probabilities p(i|j), wherein state 1 applies when the number of said occurrences exceeds a certain threshold T, and state 0 applies when the number of said occurrences falls below said certain threshold T, being represented as: $S_{n} = \left\{ \begin{matrix} 0 & {if} & {x_{n} \leq T} \\ 1 & {if} & {x_{n} > T} \end{matrix} \right.$

wherein said transition probability p(i|j) is the switching probability from state j to state i, that is, the probability that S_(n)=i given that S_(n−1)=j, being a total of 4 transition probabilities; means for computing said four transition probabilities the last N states S_(n), where N is a predetermined number; means for conducting a supervised training session utilizing a set of J devices, which have failed due to known causes and considering the two independent probabilities p(1|1) and p(1|0), said means for conducting a supervised training session comprising means for: computing the two-dimensional feature vectors f_(i)={p(1|1), p(1|0)}_(i) for the initial M windows of N scans, computing the two-dimensional feature vectors f_(f)={p(1|1), p(1|0)_(f) for the final N number of scans, plotting a scatter-diagram of all 2D feature vectors (f_(i))_(n) and (f_(f))_(n), (n=1 . . .J), and deriving a pattern classifier by estimating the optimal linear discriminant which separates the two foregoing sets of vectors; and means for applying said classifier to monitor the persistence of occurrences of said defined event in the operation of said device. 